Self-Organized Branching Processes: A Mean-Field Theory for Avalanches 
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We discuss mean-field theories for self-organized criticality and the connection with the general 
theory of branching processes. We point out that the nature of the self-organization is not addressed 
properly by the previously proposed mean-field theories. We introduce a new mean-field model that 
explicitly takes the boundary conditions into account; in this way, the local dynamical rules are 
coupled to a global equation that drives the control parameter to its critical value. We study the 
model numerically, and analytically we compute the avalanche distributions. 
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Many phenomena of interest to physicists, chemists, 
geologists, and biologists display long-range spatiotem- 
poral correlations. The critical behavior is sometimes 
apparently "spontaneous" , in contrast to typical second 
order phase transitions, where scaling occurs only when a 
parameter is tuned close to a critical value. The concept 
of self-organized criticality (SOC) was introduced to 
describe such systems which spontaneously organize into 
a critical state. 

The SOC behavior has been investigated using differ- 
ent models. Among those the most widely studied, nu- 
merically and analytically are the sandpile 
models. An important feature of such systems is that 
they respond to external perturbations by avalanches of 
all sizes s, with a power-law distribution, D{s) ~ 
where r is a scaling exponent. 

The simplest theoretical approach to SOC is mean- 
field theory |^ , which allows for a qualitative description 
of the behavior of the system. Mean-field exponents for 
SOC models have been obtained by various approaches 
[^-^, but it turns out that their values (e.g., t = 3/2) 
are the same for all the models considered thus far. This 
fact can easily be understood since the spreading of an 
avalanche in mean-field theory can be described by a 
front consisting of non-interacting particles that can ei- 
ther trigger subsequent activity or die out. This kind of 
process is well known, and is called a branching process 
pof . The connection between branching processes and 
SOC has been investigated, and it has been proposed 
that the mean-field behavior of sandpile models can be 
described by a critical branching process [T^ . 

We begin by noting the following paradox inherent in 
the previous mean-field studies: for a branching process 
to be critical one must fine tune a control parameter to 
a critical value. This, by definition, cannot be the case 
for a SOC system, where the critical state is approached 
dynamically without the need to fine tune any param- 
eter. In the present paper, we resolve this paradox by 
introducing a new mean-field model, the self-organized 
branching-process (SOBP). The coupling of the local dy- 
namical rules to a global condition, drives the system into 
a state that is indeed described by a critical branching 
process. We study the model numerically and compare 



the results of the simulations with analytical results. We 
introduce the SOBP model based on physical considera- 
tions, and then show that the mean-field theory of SOC 
models can be exactly mapped to the SOBP model. 

Sandpile models are cellular automata defined on a 
d— dimensional lattice. An integer variable, which we call 
energy, is associated with each site of the lattice. Over 
time, energy is added in integer units to a randomly cho- 
sen site in the system. Whenever the energy on a site 
reaches a critical value, the site "relaxes" and its energy 
is transferred to the neighbors according to the specific 
rules of the model. In this way, a single relaxation can 
trigger other relaxations, leading to the formation of an 
avalanche. With closed boundary conditions, the density 
of critical sites in the system will increase as a function 
of time such that eventually an avalanche of infinite life- 
time will form. Therefore, in order for the system to 
be able to reach a SOC state, it is essential to impose 
open boundary conditions such that energy can leave the 
system, thus decreasing the number of critical sites. As 
a result, regardless of the initial conditions, the system 
is driven to a stationary SOC state characterized by a 
balance between input and output, i.e., on average the 
energy added to the system is equal to the energy that 
leaves the system through the boundaries. 

In the mean-field description of the sandpile model 
{d — > oo) one neglects correlations, which implies that 
avalanches do not form loops and hence spread as a 
branching process. In the SOBP model, an avalanche 
starts with a single active site, which then relaxes with 
probability p, leading to two new active sites. With 
probability 1 — p the initial site does not relax and the 
avalanche stops. If the avalanche does not stop, we re- 
peat the procedure for the new active sites until no ac- 
tive site remains. The parameter p is the probability 
that a site relaxes when it is triggered by an external in- 
put. For the SOBP branching process, there is a critical 
value, Pc — 1/2, such that for p > pc the probability to 
have an infinite avalanche is non-zero, while for p < pc 
all avalanches are finite. Thus, p ~ Pc corresponds to the 
critical case, where avalanches are power law distributed. 

In the above description, however, the boundary condi- 
tions are not taken into account — even though they are 
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crucial for the self-organization process. We can intro- 
duce boundary conditions in the problem in a natural 
way, by allowing for no more than n generations for each 
avalanche. Schematically, we can view the evolution of 
a single avalanche of size s as taking place on a tree of 
size N = 2"+^ — 1 (see Fig. |^). If the avalanche reaches 
the boundary of the tree, we count the number of ac- 
tive sites CT„ (which in the sandpile language corresponds 
to the energy leaving the system), and we expect that p 
decreases for the next avalanche. If, on the other hand, 
the avalanche stops before reaching the boundary, then p 
will slightly increase. Note that we are not studying the 
model on a Bethe lattice, i.e., the branching structure 
we are discussing is not directly related to the geometry 
of the system. The number of generations n can, nev- 
ertheless, be thought of as some measure of the linear 
dimension of the system. 

The scenario discussed above is described by the fol- 
lowing dynamical equation for p{t): 



p{t + l)=p{t) + 



1 - 0-n(p, t) 

N 



(1) 



Here (T„ , the size of an avalanche reaching the boundary, 
fluctuates in time and hence acts as a stochastic driving 
force. If Gn = 0, then p increases (because some en- 
ergy has been put into the system without any output), 
whereas if ct„ > then p decreases (due to energy leaving 
the system) . Equation (|l|) describes the global dynamics 
of the SOBP, as opposed to the local dynamics which is 
given by the branching process. We can study the model 
for a fixed value of n, and then take the limit n ^ oo. In 
this way, we perform the long-time limit before the "ther- 
modynamic" limit, which corresponds exactly to what is 
done in sandpile simulations. 

The SOBP model can be exactly mapped to SOC mod- 
els in the limit d — > oo, i.e., it provides a mean-field the- 
ory of self-organized critical systems. To show this, we 
consider for simplicity the two-state sandpile model : 
When a particle is added to a site Zi, the site will relax 
li Zi — 1. In the limit d — > cxd, the avalanche will never 
visit the same site more than once. Accordingly, each 
site in the avalanche will relax with the same probability 
p — P{z — 1). Eventually, the avalanche will stop, and 
cr > particles will leave the system. Thus, the total 
number of particles M{t) evolves according to 



M{t+l) = M{t) + 1 - cr. 



(2) 



The dynamical equation (|l|) for the SOBP model is re- 
covered by noting that M{t) = NP{z = 1) = Np. For 
other SOC systems, mean-field descriptions similar to the 
SOBP model can be derived. 

Before investigating the SOBP model analytically, we 
present some preliminary considerations together with 
numerical results. For a fixed value of p, the average 
value of cr„ is (cr„(p, t)) = (2p)" We can write 

'^niVii) = C^pY'' + v{Pjt)j where the "noise" 77 describes 



the fluctuations around the average. Inserting this ex- 
pression in Eq. (|^) and taking the continuum time limit, 
we obtain 



dp _ l-(2p)" ^ 7]{p,t) 
dt 



(3) 



N N 

Without the last term, Eq. (||) has a fixed point {dp/dt — 
0) for p = Pc = 1/2. On linearizing Eq. (|^), we see that 
the fixed point is attractive, which demonstrates the self 
organization of the SOBP model since the noise 77 /TV will 
have vanishingly small effect in the thermodynamic limit. 
To confirm our statement, we have studied the SOBP 
model by carrying out simulations for different system 
sizes, and averaging over typically 5 x 10^ realizations. 

In Fig. H we show the value of p as a function of time. 
Independent of the initial conditions, we find that after a 
transient p{t) reaches the self-organized state described 
by the critical value pc — 1/2 and fluctuates around it 
with short-range correlations (of the order of one time 
unit). By computing the variance of p(t), we find that the 
fluctuations around the critical value decrease with the 
system size as 1/A^. Moreover, by analyzing the higher 
moments, we find that the fluctuations for 1 can be 
very well described by a Gaussian distribution, 



Hp) 



^/2^ 



■ exp 



N 



[p-pnY 



2A 



N 



(4) 



Here pN = Pc - a/N, Ajv = b/N, with a = 0.69 ± 0.02, 
and b — 0.26±0.01. In the limit N 00, the distribution 
(j){p) therefore approaches a delta function, 6(j) — pc). 

In Fig. H we show the avalanche size distribution D{s) 
for different values of the number of generations n. We 
observe a scaling region {D{s) ~ s~'^ with t — 3/2), 
whose size increases with n, and an exponential cutoff. 
The power-law scaling is a signature of the mean-field 
criticality of the SOBP model. In Fig. ^ we report the 
distribution of active sites at the boundary, D{a), for 
different values of the number of generations. This dis- 
tribution falls off exponentially. 

We now present some analytical results in the limit 
where 1. First, we discuss the branching process for 
any value of p, and show how this for the critical branch- 
ing process with p = pc yields the mean-field exponent 
T = 3/2. In addition, we can obtain results for finite, but 
large, values of n. Next, we obtain results for the SOBP 
model which, as shown in Fig. |[ self-organizes into a 
critical state where p = Pc- 

We introduce the probabilities Pn{s,p) and Qn{<J,p) of 
having an avalanche of size s and boundary size cr in a 
system with n generations. The corresponding generat- 
ing functions are defined by |l§ 



fn{x,p) 



9n{x,p) 



'Pn{s,p)x'' 



Qn{<7,p)x° 



(5a) 



(5b) 
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Due to the hierarchical structure of the branching pro- 
cess, it is possible to write down recursion relations for 
P„(s,p) and Qn{<J,p)j from which we obtain 

fn+l{x,p) = X [{l-p) +Pfnix,p)] , (6a) 



gn+i{x,p) = {l-p)+pgl{x,p), (6b) 



where fo{x,p) = go{x,p) = x. 

Next, we calculate the avalanche distribution D{s) de- 
termined by Pn{s,p) by using the recursion relation (6a) 
The solution of Eq. (6a) in the limit n ^ 1 is given by 



fix,p) = 



1 - ^l-4:x^p{l-p) 
2xp 



(7) 



By expanding Eq. (M) as a series in x, and comparing 
with the definition (pa), we obtain for sizes such that 



Pn{s,p) 



v/2(l-p)/7rp 

.3/2 



exp(-s/sc(p)). 



(8) 



The cutoff Sc{p) is given by Sc{p) = — 2/ln4p(l —p). As 
>l/2, s c{p) ^ oo, thus showing explicitly that the 
critical value for the branching process is pc — 1/2, and 
that the mean-field exponent for the critical branching 
process is r = 3/2. 

The expression (||) is only valid for avalanches which 
do not feel the finite size of the system. For avalanches 
with n ^ s <i iV, it is possible to solve the recursion rela- 
tion (|6a|), and then obtain PjAs^p) for p > Pc by the use 
of a Tauberian theorem pq-fiSf . By carrying out such an 
analysis, we obtain after some algebra 



Pn{s,p) ~ A{p) exp (-s/so(p)) 



(9) 



with functions A{p) and so{p) which can not be deter- 
mined analytically. Nevertheless, we see that for any p 
the probabilities P„(s,p) will decay exponentially. 

The final step is to calculate the avalanche distribution 
D{s) for the SOBP model. This can be calculated as the 
average value of P„(s,p) with respect to the probability 
density 0(p), i.e., according to the formula 



Dis) 



dp(j){p) Pn{s,p). 



(10) 



The simulation results in Fig. g show that (t){p) for ^ 1 
approaches the delta function 5{p—pc) [cf. Eq. (^]. Thus, 
for 1 ^ s n, we obtain the power-law behavior 



D{s) 



(11) 



where r = 3/2, and for s ^ n we obtain an exponential 
cutoff exp{— s / so{pc)) ■ These results are in good agree- 
ment with our numerical results shown in Fig. ^. The 



deviations from the power-law behavior ( |11| ) are due to 
the fact that Eq. (§) is only valid for 1 < s < n 
Performing a more accurate calculation, by the use of the 
Gaussian distribution (H) instead of the N ^ oo limit, 
S{p — Pc), we recover the power-law behavior in Eq. (ITl 
with correction terms. 

In an analogous fashion, we can calculate the asymp- 
totic form of (3n(cr,p) for 1 <C cr ^ n and p > Pc the 
use of a Tauberian theorem, with the result 



Qn{(T, p) 



CTo(l + CTo) 



exp (-(t/(To(p)) , 



(12) 



where CTo(p) = ((2p)" - 1) /21n2p. Hence, in the SOBP 
model, the boundary avalanche distribution is 



/■I g 

D{a) = / dp<p{p)Qn{cr,p) = — exp (-2(7 
Jo ^ 



/n), (13) 



which agrees with our simulation results for n 3> 1 as 
shown in Fig. ^ Q . 

The avalanche lifetime distribution L{t) ^ t^^ can also 
be computed. From D{am — 0) = 1 — 2/m ||l^ for a sys- 
tem with m generations, we obtain L{ra) ^ ra""^ . Identi- 
fying the number of generations m of an avalanche with 
the time we thus obtain the mean-field value y = 2. 
This result is in complete agreement with simulations on 
the SOBP model. 

In summary, we have introduced a self-organized 
branching process (SOBP) that captures the physical fea- 
tures of the self-organization mechanism in sandpile mod- 
els. Previous investigations have focused on the critical 
branching process as the mean-field description of sand- 
pile systems. In the SOBP model, however, by explicitly 
incorporating the boundary conditions, we were able to 
show, using Eq. (j^), how the dynamics drives the system 
into a stationary state, which in the thermodynamic limit 
corresponds to the critical branching process. We have 
calculated the avalanche distributions analytically, and 
found the mean-field result r = 3/2, in good agreement 
with our simulation results. 
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FIG. 1. Schematic drawing of an avalanche in a system 
with a maximum of = 3 avalanche generations correspond- 
ing to = 2"+^ — 1 = 15 sites. Each black site relaxes with 
probability p to two new black sites and with probability 1—p 
to two white sites. The black sites are part of an avalanche 
of size s = 7, whereas the active sites at the boundary yield 
a"3(p,t) = 2. Note that s in the SOBP model must be an odd 
integer while On will be even. 
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FIG. 3. Log-log plot of the avalanche distribution D{s) for 
different system sizes. The number of generations n increases 
from left to right. A line with slope r = 3/2 is plotted for 
reference, and it describes the behavior of the data for inter- 
mediate s values, cf. Eq. (|l^). For large s, the distributions 
fall off exponentially. 
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FIG. 2. The value of p as a function of time for a system 
with n = 10 generations. The two curves refer to two different 
initial conditions, above pc (•) and below pc (o). After a 
transient, the control parameter p{t) reaches its critical value 
Pc and fluctuates around it with short-range correlations. 



FIG. 4. Semilogarithmic plot of the boundary avalanche 
distribution D{a) for different system sizes [|l^. For large o, 
the distributions fall off exponentially. The solid lines are our 
analytical results of Eq. (^3|) for n ^ 1. We note that the 
agreement improves with increasing n. 
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